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SURVEILLANCE SYSTEM AND METHOD WITH ADAPTIVE 
FRAME RATE 

/. Field of the Invention 
[0001] The present invention relates generally to surveillance systems. 



//. Background of the Invention 

[0002] Surveillance systems are used in a wide number of applications to promote security. 

Typically, a surveillance system includes one or more video cameras that are mounted in a location 
sought to be monitored. The cameras send video footage to central monitoring areas where the video 
is observed by security personnel, or stored for later viewing, or both. 

I* 

C|0003] As recognized by the present invention, existing surveillance systems suffer several 

n 

|T drawbacks. One drawback is that the resolution of most systems is less than what might be desired, 

N making it harder for security personnel to recognize people imaged by the system. Increasing the 

!=* 

\Q resolution of surveillance video, however, requires increasing the rate at which video frames are 

13 

, updated, i.e., it requires generating more data. This in turn increases the burden on the video storage 

|* resources of the system. Moreover, as recognized by the present invention the higher the data rate 
H= the more stressed the capacity of a transmission system which might be used to send the data 
§ elsewhere. 

"[0004] Specifically, as mentioned above the surveillance video typically is fed to a monitoring 

location, which means that security personnel must be present at the monitoring location to view the 
video in real time. As recognized by the present invention, however, it is not always practical for 
security personnel to be tied down to one location. Rather, it is often desirable that security 
personnel patrol surveilled premises, but existing surveillance systems do not provide real time video 
to roaming security personnel. The present invention understands that viewing surveillance video 
in real time can be an important and valuable tool for patrolling security personnel. 
[0005] However, as still further recognized herein, in some applications it might be desirable to 

maintain surveillance video images in a secure system, to prevent eavesdroppers from accessing the 
video. This requirement might be further heightened in the case of a surveillance system that could 
provide video in real time to patrolling security personnel. Having made the critical observations 
discussed above, the present invention provides the below-disclosed solutions to one or more of the 
prior art drawbacks. 
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SUMMARY OF THE INVENTION 

[0006] A method for surveillance includes generating a video of a surveilled location using a camera, 

and dynamically establishing a frame rate of the video based on motion in the surveilled location. 
In this way, lower data rates are used when little or motion exists, to minimize the bandwidth 
requirements of a transmission system that might be used to transmit the video, while facilitating 
higher data rates when called for, i.e., when motion is detected. 

[0007] In a preferred embodiment, the motion is identified based on changes between frames of the 

video. In another embodiment, the motion is identified using a motion detector at the location. 

[0008] As contemplated herein, the video is transmitted, preferably after user authentication, to a 

mobile wireless receiver for display of the video on a terminal that is associated with the receiver. 
J* Indeed, the video can be transmitted to plural mobile wireless receivers, in real time if desired. 

p Moreover, electronic or paper billing documents can be generated based on the transmitting act. 

U 

Videos can be generated of respective surveillance locations for routing the videos to respective 
wireless receivers in response to user requests for videos. 
□[0009] In one non-limiting embodiment, the frame rate is a rate of processing and/or compressing 

| a entire frames. In another embodiment, the frame rate is a rate of processing and/or compressing only 

1^ regions of an entire frames, that is, there is a variable amount of compression in different regions, 

[y such that one region might be compressed at a first rate and a second region might be compressed 

I* at a second rate different from the first rate, or not at all compressed. 

[0010] In another aspect, a surveillance system includes a source that transmits surveillance video 

using wireless data transmission principles. A system hub receives the video from the source. At 
least one wireless receiver is in communication with the hub for receiving video from the hub. 
[001 1] In yet another aspect, a surveillance method includes disposing at least one video camera in 

at least one location to be surveilled, and using the video camera to generate a video feed. A frame 
rate that is associated with the feed is varied based at least in part on motion of at least one object 
at the location. The video feed is then transmitted in real time to at least one monitoring receiver 
over a wireless link. 

[0012] In still another aspect, a system includes plural video surveillance cameras disposed in plural 

locations sought to be monitored, with at least one of the cameras having a variable frame rate that 
bears a relationship to motion in the respective location. At least one system hub communicates with 
the cameras and receives signals therefrom. Plural client receivers are in wireless communication 
with the hub for receiving video streams therefrom. 
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[0013] The details of the present invention, both as to its structure and operation, can best be 

understood in reference to the accompanying drawings, in which like reference numerals refer to like 
parts, and in which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] Figure 1 is a block diagram of a presently preferred surveillance system; 

[0015] Figure 2 is a flow chart of the overall logic of the frame rate algorithm; and 

[0016] Figure 3 is a flow chart of one non-limiting example of logic for establishing the frame rate 

in response to motion in a surveilled location. 

\* DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

p 

f -10017] Referring initially to Figure 1 , a system is shown, generally designated 10, for effecting video 

ih surveillance in plural locations 12 and for selectively sending surveillance video, preferably in real 

f * time, to one or more requesting clients 14, which can be mobile or portable clients, via a system hub 

I j 16 preferably using wireless transmission principles known in the art. 

i J0018] As shown in Figure 1, at least one respective surveillance video source 18 is disposed in each 

pJ location 12. Taking the source 18 shown at the top of Figure 1 as an example, the source 18 includes 

i* 

IH at least one video camera 20 which generates a video stream or feed composed of video frames. The 

J J generated video is sent to a compression module 22 that functions in accordance with the disclosure 

below to dynamically establish the frame rate and to compress the video. The compressed video is 
then sent to a transmitter 24, preferably a wireless transmitter, and if desired is also stored in a local 
storage 26. 

[0019] According to the preferred implementation shown in Figure 1, the transmitter 24 of each video 

source 18 sends video to the system hub 16 over a wired or wireless link. The hub 16 includes a 
router 28 that routes video streams to requesting clients 14 using a wireless link. The clients 14 can 
access the video streams by establishing communication with the hub 16 and authenticating 
themselves to a conditional access module 30 at the hub 16. That is, to access a particular stream 
a client 14 establishes communication with the hub 16 and requests a particular video stream from 
a client-selected location 12, with the conditional access module 30 permitting (or not) the client 14 
to receive the selected stream, depending on the client's authentication. Consequently, access to the 
surveillance video streams generated by the sources 18 can be controlled by the hub 16 on a client- 
by-client basis. 
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[0020] Moreover, the conditional access module 30 can authenticate a source of video by, e.g., 

determining whether a source has properly digitally "signed" a video stream. In this way, a client 
can be assured that what he or she is viewing indeed comes from the desired source. With the above 
discussion in mind, it is to be appreciated that the conditional access module 30 essentially secures 
the link between source and client. 

[0021] To provide a requested video stream to a properly authenticated client 14, the hub 16 

transmits the video stream over a wireless link to the requesting client 14. Since the link is wireless, 
the client can be mobile, e.g., the client can be a portable laptop computer or other computing device 
that can be borne by a patrolling security guard, e.g., a data-enabled handset. To this end, each client 
14 includes a wireless receiver 32, a local processor 34 receiving signals from the receiver 32, and 

§4 a video monitor 36 that outputs video images. A local storage 38 can also be provided to store video 

(3 

II streams. 

!|0022] In accordance with the present invention, the system 10 uses wireless data communication 

i* techniques such as TDMA, CDMA, WCDMA, or satellite communication systems such as Global 
O Star®. In one non-limiting embodiment the system 10 uses Code Division Multiple Access (CDMA) 
principles and a CDMA over-the-air (OTA) communication air interface, which can include 
JU protocols such as are defined in but not limited to IS-95A, IS-95B, WCDMA, IX, IXCV, EV and 
flj DV, IS-2000, and others. 

• j0023] For instance, the wireless communication systems to which the present invention can apply, 

in amplification to those noted above, include Personal Communications Service (PCS) and the 
following digital systems: CDMA, WCDMA, and hybrid Time Division Multiple Access 
(TDMA)/CDMA technologies. A CDMA cellular system is described in the Telecommunications 
Industry Association/Electronic Industries Association (TIA/EIA) Standard IS-95. Other 
communications systems are described in IS-98 and in the International Mobile Telecommunications 
System 2000/Universal Mobile Telecommunications Systems (IMT-2000/UM), standards covering 
what are referred to as wideband CDMA (WCDMA), cdma2000 (such as cdma2000 lx or 3x 
standards, for example) or TD-SCDMA. 
[0024] The present invention can be used with any wireless system. In general, wireless 

communication devices which can be incorporated in, e.g., each client 14 may include but are not 
limited to a wireless handset or telephone, a cellular phone, a satellite phone, a data transceiver, or 
a paging and position determination receiver, and can be hand-held, or portable as in vehicle- 
mounted (including cars, trucks, boats, planes, trains), as desired. However, while wireless 
communication devices are generally viewed as being mobile, it is to be understood that the present 
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invention can be applied to "fixed" units in some implementations. Also, the present invention 
applies to data modules or modems used to transfer voice and/or data information including digitized 
video information, and may communicate with other devices using wired or wireless links. Further, 
commands might be used to cause modems or modules to work in a predetermined coordinated or 
associated manner to transfer information over multiple communication channels. Wireless 
communication devices are also sometimes referred to as user terminals, mobile stations, mobile 
units, subscriber units, mobile radios or radiotelephones, wireless units, or simply as "users" and 
"mobiles" in some communication systems. 
[0025] Figures 2 and 3 illustrate the structure of the logic of the compression module 22 as embodied 

in computer program software. Those skilled in the art will appreciate that the flow charts illustrate 
M the structures of logic elements, such as computer program code elements or electronic logic circuits, 

a 

13 that function according to this invention. Manifestly, the invention is practiced in its essential 
I "7 embodiment by a machine component that renders the logic elements in a form that instructs a digital 
I* processing apparatus (that is, a computer, controller, processor, etc.) to perform a sequence of 
Q function steps corresponding to those shown. 

\ J0026] In other words, the logic may be embodied by a computer program that is executed by a 

f U processor within, e.g., the video source 18 as a series of computer- or control element-executable 
I y instructions. These instructions may reside, for example, in RAM or on a hard drive or optical drive, 
P or the instructions may be stored on magnetic tape, electronic read-only memory, or other appropriate 

data storage device that can be dynamically changed or updated. 
[0027] Commencing at block A in Figure 2, an indication of motion in a location 12 is received. 

This indication might come, for example, from a motion sensor 39 (Figure 1) that is disposed in the 
location 12 and that communicates with the module 22. More preferably, the indication of motion 
is derived from the video image itself, as discussed further below in reference to Figure 3. At block 
B of Figure 2, the video frame rate can be established, if desired, based on the amount of motion in 
the location 12. That is, the more motion, the faster the rate. When little or no motion is sensed, the 
video frame rate can be minimized to minimize the bandwidth requirements imposed on the wireless 
transmission system. The video is then compressed after the frame rate is established. 
[0028] Figure 3 shows one exemplary, non-limiting method to establish a video frame rate based on 

motion. Commencing at block 40, the frame rate can be initialized at a nominal value, e.g., at a 
minimum rate. Then, plural frames can be received at block 42 for comparison. The frames to be 
compared can be individual frames, either immediately adjacent to each other in the video stream or 
separated from each other by other frames. Or, frame composites can be used, i.e., the average pixel 
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values from "n" frames can be compared on a pixel-by-pixel basis against the average pixel values 
from the preceding "n" frames. In undertaking the comparison, the entire pixel array can be 
considered, or only regions of the array, with a single frame rate being established or with different 
frame rates for different regions of the array being established, respectively. 
[0029] Decision diamond 44 represents one comparison that can be made. Specifically, at decision 

diamond 44 it is determined whether the values for a predetermined number of pixels have changed. 
Other heuristics can be used, however, to determine whether motion exists in the location 12 based 
on a frame-to-frame comparison. For instance, motion might be indicated only if a threshold 
percentage of pixels has changed in each of three or more successive frames. 
10030] If the test at decision diamond 44 is positive, meaning that motion above a predetermined 

I a threshold has been sensed, the logic moves to block 46 to increase the frame rate of the entire frame 
J~ or, if regions of the frame are being compared, of the respective region. The frame rate can be 
M= increased by a single discreet value or it can be increased in proportion to the amount of motion 
I a sensed, i.e., in proportion to the number of pixels that have changed. 

jijxm] Additional frames can be received at block 48 and compared to each other at decision 

: diamond 50 to determine whether motion has stopped or otherwise fallen below a predetermined 

f fy threshold. For example, it can be determined whether less than a predetermined number of pixels 
III has changed, and if so the frame rate is decreased at block 52. Figure 3 shows that the logic 
j«f continues to loop as the video stream is generated. Electronic or paper billing documents can 
subsequently be generated to bill a client 14 for receiving video feeds. The billing information can 
be collected by the hub 16 and securely transmitted to a billing authority. 
[0032] While the particular SURVEILLANCE SYSTEM AND METHOD WITH ADAPTIVE 

FRAME RATE as herein shown and described in detail is fully capable of attaining the above- 
described objects of the invention, it is to be understood that it is the presently preferred embodiment 
of the present invention and is thus representative of the subject matter which is broadly 
contemplated by the present invention, that the scope of the present invention fully encompasses 
other embodiments which may become obvious to those skilled in the art, and that the scope of the 
present invention is accordingly to be limited by nothing other than the appended claims, in which 
reference to an element in the singular is not intended to mean "one and only one" unless explicitly 
so stated, but rather "one or more". All structural and functional equivalents to the elements of the 
above-described preferred embodiment that are known or later come to be known to those of ordinary 
skill in the art are expressly incorporated herein by reference and are intended to be encompassed by 
the present claims. Moreover, it is not necessary for a device or method to address each and every 
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problem sought to be solved by the present invention, for it to be encompassed by the present claims. 
Furthermore, no element, component, or method step in the present disclosure is intended to be 
dedicated to the public regardless of whether the element, component, or method step is explicitly 
recited in the claims. No claim element herein is to be construed under the provisions of 35 U.S.C. 
§1 12, sixth paragraph, unless the element is expressly recited using the phrase "means for" or, in the 
case of a method claim, the element is recited as a "step" instead of an "act". 



